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Seven microcomputer-based training systems with 
videotape players/monitors were installed to provide electronic 
counter-countermeasures (ECCM) simulation training, drill and 
practice, and performance testing for three courses at a fleet combat 
training center* Narrated videotape presentations of siiulated and 
live jamaing followed by a drill and practice session aid performance 
test were presented to 357 trainees- The objective was to train 
students in electronic counter measures (ECH) recognitict in a more 
effective, mode than can be achieved through traditional classroom 
lecture and textbook presentation of jamming examples, ihe lesson on 
basic jamming recognition presented training in recogni2ing and 
identifying general types of ICM. The microprocessor was programmed 
1° <!L.S resent the materials in response to student input through the 
Keyboard,, (2) evaluate student performance and provide feedback when 
appropriate and (3) keep a complete record of all responses and 
response times. The results indicated a significant improve aent in 
posttest over pretest scores, and attitudinal surveys showed a highly 
positive attitude .toward the type of training used, ihe 
microcomputer-based ^training system was effective and reliatle, 
meeting with project expectations, Future project efforts irclude 
revisions and extension of the present system. Three references are 
cited, (Author/CBC) 
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FOREWORD 



This development effort was conducted in support of advanced development project 
Z1177-PN (Advanced Computer-aided Instruction), subproject PN.01 (Remote Site Train- 
ing Using Microcomputers), and was sponsored by the Chief of Naval Operations (OP-01). 
The purpose of this subproject is to conduct training research to improve electronic 
counter-countermeasures (ECCM) training readiness in the surface fleets. 

This report is the first in a series addressing this subproject. Results are intended for 
officials concerned with ECCM readiness and training in the Office of the Chief of Naval 
Operations, Chief of Naval Material, Commander Naval Sea Systems Command, Com- 
mander Naval Electronics Systems Command, Chief of Naval Education and Training, 
Commanders Training Command, U.S. Atlantic and Pacific Fleets and for fleet readiness 
staff officers. <*. 

The outstanding cooperation of personnel of the following ships and staffs is very 
much appreciated: Commander Training Command, U.S. Pacific Fleet; Commander 
Carrier Group THREE; USS KITTY HAWK; Fleet Combat Training Center, Pacific; 
Commander Fleet Electronic Warfare Support Group; USS GRIDLEY; USS LEAHY; USS 
BERKELEY; USS LEFTWICH; Commander 3oint Electronic Warfare Center; Commanding 
Officer, Tactical Electronic Warfare Squadron 135; and Commanding Officer, Fleet 
Combat Systems Training Unit, Pacific. 



JAMES F. KELLY, JR. 
Commanding Officer 



JAMES J. REGAN 
Technical Director 
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SUMMARY 



A retirement for improved ECCM readiness has existed for several years in the 
surface forces. A major problem has been lack of opportunity for radar operators to 
engage in interactive training where realistic jamming and chaff are used and where 
individuals are scored as to time and accuracy. 

It is a basic premise that naval warfare will surely entail electronic countermeasures 
(ECM) against most sensors— including radars. Rapid and accurate electronic counter- 
countermeasures (ECCM) must be used to detect and track targets, a task not possible 
with untrained operators. 

• ECM, being a provocative act during peacetime, is not present in normal operations 
for training purposes. The exception is during fleet exercises, which provide opportunities 
for some operators to observe jamming and chaff. However, it appears that interactive, 
individual operator involvement in responsible tasks of recognition, reporting, and ECCM 
fix applications is lacking. 

Objective 

The objective of this effort was to investigate the effectiveness of microprocessor- 
based training systems to deliver critically needed traimng-both initial and refresher— to 
fleet operational personnel at fleet combat training centers and remote sites. 

Approach 

Seven microprocessor-based training systems with videotape players/ monitors were 
installed at the Fleet Combat Training Center, Pacific to provide ECCM training. A totai 
of 357 trainees participated in one of the following four courses: combat information 
center (CIC) radar jamming recognition and countermeasures, CIC watch supervisor, a 
special prefleet exercise course called "Readiex," and advanced operations specialist. 

i 

Na \ rated videot f Presentations of simulated and live jamming were presented 
followed by a drill arid practice session and performance test. The objective was to train 
students in ECM recognition in a more effective mode than can be achieved through 
traditional classroom lecture and textbook presentation of jamming examples. The lesson 
on basic jamming recognition presented training in recognizing and identifying general 
types of ECM. The microprocessor was programmed to (1) present the materials in 
response to student input through the keyboard, (2) evaluate student performance and 
provide feedback when appropriate, and (3) keep a complete record of all responses and 
response times. 



Findings 

Students showed a significant improvement in posttest over pretest scores. Attitu- 
dinal surveys showed a highly positive attitude toward the type of training used. Actual 
jamming displays provided the basis for much of the favorable remarks by the students. 
The microcomputer-based training system (including the associated videocassette equip- 
ment) was effective in providing the necessary simulation, drill and practice, and 
performance testing for ECCM training. The equipment down-time was very low and 
maintenance costs were significantly lower than anticipated. 
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Conclusions 

1. Microcomputer-based training systems are effective for providing ECCM train- 
ing for radar operators. 

2. Fleet students have a highly positive attitude toward the type of training as 
presented by the microcomputer-based training systems, during this evaluation. 

3. ECCM training should include realistic simulation of jamming, chaff, and 
deception as it is likely to occur in combat, and performance scoring for individual time 
latencies and accuracy. 

4. System hardware and software are reliable and meet project expectations. 
Future Direction ._ 

Future project efforts include the completion of planned development and evaluation 
of ECCM application, an improved ECM recognition module, ECM reporting, an investiga- 
tion of refresher training requirements for ECCM, and EW threat evaluation training. 
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INTRODUCTION 

Problem 



types of emissions parSble d^in»T«rdses R«, 1« '"• SCOpC dUe ,0 re ? ,ric,ions on 
Posing neSr^^o^Sir^^^^^^ ^ '< ! 

ECM. Given the advanced tyS of training JEt^ a **J j*"* 11301 pri ° r ex P° sure to 

and recommended that the Navy Personnel rS 7 F T° gram 10 the Surface Navv 
RANDCEN) M^E^M^^^ST^£^^ mt ^ (NAVPERS - 
representative to the CNET Z aS r J IC Fleet Trainin S Comm and 

requested NAVPER^DAwnr-BM ♦ • . . vlS0rv Group meeting in November 1977 also 
K^SraniS^ *^ to - mtiate trainin 8 research in ECCM. As a result 

Background 

the uTNav/s SRttS^S of T 0, . Ving actions ^ to ensure 

use of countermeTsures It con^t,^ c * oma g n< ; tlc radiations in spite of the enemy's 
equipment techno^ methods, and 

operas ^^^''gSS? d^estd^ 3 ' "IT ^ 
interference is not present- thu f it should I 2 * f 1 , Performance when amming or 
when jamming or interference is orelm) Th' ° nly whet l absolutel y necessary (i.e., 
performance during operatiST^uiSS f0r radar System 

suited in decreased SS^^S^^til^^ E ^ encounters > ha* 
current status of ECCM reaSfness ta Se stJace Navy ' C ° ntnbutin S faCl0r to the 

radar^^ in E <*M readiness is that the 

Activation of ECCM d^^*^ ?™ e! ^oleS £ -on. 
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majority of ECCM techniques, degrade the performance of the radar and do not indicate 
to the operator that the circuit is functioning properly. In the normal (peacetime) 
operating, environment, the radar operator of ECCM-capable equipment will not encounter 
ECM, except during an EW exercise. The radar operator, because of the characteristics 
of his equipment, cannot "tune 11 the equipment (except through some limited range 
established by design criteria) to "find" ECM. Therefore, before he is exposed to an 
environment where he is expected to gain ECM/ECCM experience and learn the 
ideosyncrasies of his own equipment, he should be trained so that he is familiar with the 
types and characteristics of anticipated ECM, has had practice in detecting and 
identifying basic types of ECM, and has knowledge of the effect of ECM techniques on 
radar system performance. 

Fleet radar operator personnel do not have sufficient training opportunities in 
recognizing types of ECM jamming nor in the application of proper ECCM techniques. 
Microprocessor- based videotape training systems w$re configured and evaluated as a 
means of providing individualized training in recognizing and responding to electronic 
countermeasures and of recording individual responses and response times. 

V 

The technological opportunities provided by such systems were investigated in an 
effort to address the Navy's need for small, light-weight, low-cost instructional systems 
and associated media. These systems can augment classroom training by providing 
critically needed individualized initial and refresher training for combat skills requiring 
hands-on training. In addition, these systems can (1) be used to support large-scale 
simulation trainers, (2) provide gaming environments to 'simulate operational problems, 
and (3) be deployed at remote site* for job-site training. 

Previous ECCM recognition training primarily consisted of oversimplified drawings 
and black-and-white still photographs thaf were not capable of presenting the dynamic 
qualities necessary to train students to recognize ECM. Since signals displayed on radar 
scopes are highly dynamic, it appeared that the objectives of training radar operators in 
ECM recognition could be best satisfied by media possessing dynamic (motion) capability 
and synchronous audio. Additionally, a capability for rapid access to instruction in serial 
and nonserial fashion was a desired feature. Ease and cost of maintaining and updating 
perishable ECCM instructional materials were additional considerations. Videotape 
players with random access capability were selected as best meeting the training 
objectives for ECCM recognition training. 

Pur poses 

The objectives of this research were (1) to evaluate the effectiveness of the 
microprocessor-based training system configured for presenting ECCM simulation training 
in recognizing and responding to ECM, (2) to evaluate the ECCM training developed for 
use on this system, and (3) to set forth follow-on needs to complete a basic upgrading of 
surface Navy ECCM training. 



METHOD 

Capabilities Needed 

Based upon an analysis of the ECCM training required (Pearson <3c Stubbs, 1975), the 
following capabilities were specified for the planned training systems: 

1. Presentation of microprocessor-based simulation of the types and characteristics 
of anticipated electronic countermeasures. 
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2. Drill in detecting and identifying ECM via a simulated presentation of the radar 
system plannea position indicator (PPI) scope with individualized feedback. 

i 

3. Instruction in ECCM options, in level of effectiveness order, for countering 



ECM. 



0. Practice in applying ECCM techniques associated with specific radar systems. 

5. Individualized performance testing, including recording student response and 
response time. ^ 

Videotapes of simulated ECM radar jamming present enough complexity to account 
for significant sources of variance in the real world, while presenting basic types of ECM 
that are simple enough to provide practice in recognition before advancing to more 
complex types. Providing microprocessor-based simulation in ECCM offers the following 
advantages: (1 more training on different types of ECM prior to engaging in advanced at- 
sea exercises, (2) encouragement of student exploration of alternative responses to the 

ZTZZ^Ll^™ Wltf ? Ut haVing t0 a "y Possible negative consequence! 

that might result from applying an incorrect fix; and (3) individual student feedback and 
monitoring. By recording the individual student's response and response time, each 
student's progress can be monitored. This feature addresses a TAEG finding r^gardine 
analysis of 131 FEWSG training exercise reports (covering the period 1975 to March 1980): 

2c^^Sf?r? "I ^'f and , D re P° rtin f format it impossible to do a meaningful 
ECM/ECCM statistical analysis (Pearson & Stubbs, 1980). 

Preliminary Development 

A substantial amount of preparatory effort preceded the development of the current 
\Z :u h6Se ei H~ inc / luded: / S l) orientat i°n and familiarization of project personnel 
with the areas of ECCM/EW, (2) specification of training delivery system' requ^ement 
equipment for the test and evaluation phase, and (3) developnVent of an 

m a y - Details of this ,ast ef f ort are provided ° n 5 - 

Training System Description 

,TM \ 



The training system consisted of a TERAK microcomputer and a Sony Betamax 
video cassette tape player. 1 The TERAK, which is shown to the right in Figure 1, consists 
« microcomputer with a 56K Byte memory, a display unit, an ASCII keyboard 
and two flexible disc drives. The microcomputer and video units each occupy less than \ 
cubic foot and weigh approximately 00 pounds. The computer display unit is a 12-inch\ 
black-and-white monitor mounted in a free-standing pedestal base cabinet that places the\ 
horizontal center hne of tne display at a comfortable viewing height. The graphics 
display unit provides a 3,20-dot wide~2«0-dot high raster-scan displfy. User p?S?am 
can simultaneously display both graphics and a 24 x 80 alphanumeric character array? ™ 
this application, specific keypads were covered with labels corresponding to types of 
jamming so that a student could rapidly enter a response to the jamming scenarios afthey 
were displayed on the videotape monitor. The entire microcomputer system as described 
above is currently available for approximately $10,000. The video player, videotape 
monitor, and remote control unit are available for an additional $2 000 



'Identificaticn of the specific equipment is for the purpose of completeness of 
reporting. The Navy Department does not endorse specific products. 
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^ Figure 1. Microprocessor-based ECCM training system configuration. 

A remote' control unit (to the left of the keyboard in Figure 1) was used for student 
control of the videotape sequence. For example, a student who wanted to review a 
particular sequence could do so by entering the videotape counter reading start point for 
that particular jamming segment and then commanding the videotape player to search for 
it. Thd remote counter unit was very efficient for this purpose as it has a very rapid and 
accurate search capability. 

Thj; terminals were located in a classroom designated as the ECCM laboratory at the 
Fleet Combat Training Center, Pacific (FCTCP) (see Figure 2). The microprocessors used 
in this research were equipped with an additional flexible disc drive for recording student 
performance data and earphones were used to listen to the narrated portion of the 
videotapes. 

Training Materials 

The materials were designed to train students to perform their jobs as surface ship 
radar operators in an ECM environment. Radar jamming recognition and ECCM fix 
applications are crucial to performance of this task. Training for the terminal goal 
behavior of target detection and tracking by clearing or partial clearing of the radar 
scope was divided into four lessons: basic jamming recognition, two advanced jamming 
recognition lessons, and ECCM fix application. This report covers only the evaluation of 
%ksic jamming recognition lesson - Advanced jamming recognition lessons for the 
AN/5P5-10 and AN/SPS-43 radars and the ECCM application lessons are currently beine 
evaluated and will be reported on in FY82. 
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figure 2. ECCM laboratory at FCTCP. 



Development of Training Media Library 

Paaf,c personnel, and involved many days of shipboard tapiTandKrt cSSSt? % 

/rT^S,x Y 1000 At_sea sfu P s were USS KITTY HAWK (CV 63) and IISS FFTwrrw 

7** SimUlated by in * ectin 8 ^gnais into the f^etoe ftSES 
IIF) strip of air and surface search radars bv the MPrvri o-.^.mL t- • irequency 

capable <rf stimulating multipte serco™ a£ard ZtZ^U""^ ' ^ ™ 

Basic Jamming Rec ognition Lessons 
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Radar PPI monitor displays were presented to students on three videotapes (A, B, and 
C), which the student was guided through via instructions presented on the micro- 
processor. Tape "A" presented a 20-minute narrated secyjence of various examples of 
basic jamming types with information concerning details and means of distinguishing 
between the different types (e.g., FM pulse versus synchronous pulse). Two jamming 
segments were shown on each scope display and each jamming segment included three 
sectors— a main lobe and two side lobes. These segments were presented at 000° bearing 
and 180° bearing. An example is shown in Figure 3. Each lobe was approximately 2^ wide 
with an average sector of 15° between lobes so that the upper segment included that 
portion of the PPI scope between 300°-035° and tht segment spanned the 130°-245° 

portion. 

r 




Figure 3. Videotape of jammed radar PPI scope. 



' Five targets were presented, one each at bearings 000°, 030°, M0* f 2<*0°, ind 270° to 
..illustrate the effects of jamming on the operator's ability to see targets. Each pair of 
; jamming segments was shown for five PPI radar scope rotations or approximately 60 
seconds. Nine types of jamming were used: noise, AM noise, FM noise, swept noise, 
asynchronous pulse, FM pulse, swept synchronous pulse, synchronous pulse, and no 
jamming. 

The type of information presented in a lesson included statements intended to assist 
the student in learning to distinguish among various jamming types. These statements 
were^tncluded on the audiotrack of the videotape when a contrasting example of jamming 
was. shown. In this first ECCM training development effort, the videotape player and - 
monitor were not interfaced withJhe computer. (See the recommendations section of this 
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oTcL J) To ^ ? eed ° nt6rfaCe thC videota P e P la y er with the micro 

♦ coordinatlon of Vlewin 8 and responding to the proper jamming 
sequence, the computer presentations for all three videotapes indicated the beginning and 

sttrsaraasg: and the for the jammin * -~ 

Drill and practice (Tape B) presented VI examples of the nine basic jamming types 

was't ^^emifv7he a 7a: m iL St h reSSed ? duril * the trai ™* TheluS 

keyboard Jamming_by pressing one of a group of specially marked keys on the 

The posttest (Tape C) consisted of the same VI jamming signals presented in a 
at the completion of both drill and practice and the posttest. F"*y«=u 
Subjects 

,_ : _ A . J t0t f f 1 . 0f f 3 f (f,ee , t) trainees Participated in this research effort. All students 
•~~6M~.ro xne following four courses received the microprocessor-based ECCM training- 
combat information center (CIC) radar jamming recognition and count ermeasures CIC 

^s^saiiSK" prefleet exercise course caiied ,,Readiex " and ad -- d 



Procedure 



A J,TZ ™ cr °P rocessor ;. te sed ECCM training systems were available for student use. 
ADriM 981 ) as mrfS ^ r, f 1C,pa,ed ,n the ™">P"ter-based ECCM training (March mo- 

~„ ass Wormally to those s, * ents ^ — -*« ; ° V£ srs 

Each student signed on to the system and began to proceed through the materials 
IJstem S L[ZZLT gn ^°\ l TZ^ an orie ^tion^to the microp^oJSSS 
the th™ee^raiZ SlS PP 5?TV ely mmUteS and an ei 8 ht - item Fetesithat preceded 
im~ as ^ f ^ T C ° Uraged t0 8° trough each videotape as many 

times as needed to become proficient before advancing to the next tape in sequence 
SSSK?-? 6 *- mlcr °P roc « sor -^ed training, all students responded to the 
reaction questionnaire The instructors wanted all students to receive the si m Son 
training. Since time limitations did not allow a counter-balanced design, the e was no 
control condition. Effectiveness was determined by changes in pretest-posttest sco?2! 

The computer presented the material, monitored student performance and kent a 

t C h 7£nin eC ° rd ° f aH - reSP ° nSeS and reS P° nSe timeS - Students w^re required to compete 
the training segments in sequence: pretest, narrated training tape, drilland practice and 
performance test. While scores received on drill and practice did no contributed the 
S ^Jf l °J the f laborator y P° r «°" * the complete course, scoring Wgn Sn the dru! 
and practice portion of the training was generally a prerequisite for receiving a high sco e 
on the posttest. Thus, most students who scored low on drill and practice were motivated 

SeTalm^JXiv^ - r J instructo 5 and t0 ^ the drilled practice portion of 
the training until they attained a reasonably high score. 

The laboratory portion of each of the four courses was meant to supplement the 
regular curriculum taught by the instructor; specifically, to ?ain stS TTeCM 
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recognition in a more effective mode than can be achieved through traditional classroom 
lecture and textbook presentation of jamming examples. The regular ECCM and the 
advanced operations specialist course students received approximately 20 hours per 
student of lab time on the systems. This lab consisted of basic ECM recognition^ ' 
(narration, drill and practice, and performance testing) and radar-specific advanced £€M 
recognition (with narrated tapes, drill and practice, and performance testing). The CIC 
watch supervisor course students received approximately 7 hours in basic ECM recognition 
training. The special course for Readiex training consisted of about 7 hours of combined 
basic and advanced, radar-specific ECM recognition. 

• Analysis 

To assess whether the microprocessor-based training resulted in improved ECCM 
capabilities, statistical analyses were performed utilizing pre- and posttest scores for 
students particijjating in the four different courses offered at FCTCP. The major 
question posed in these analyses was whether participation in the training program 
significantly improved the students' ECCM recognition ability. This question was 
addressed through analyses of differences between pretest and posttest scores. A second, 
related c^estion was whether improvement occurred regardless of initial differences in 
performance in the four classes. 



RESULTS AND DISCUSSION 

Student Experience 

Table 1 presents rates of students who participated in ECCM, watch supervisor, 
Readiex, and advanced OS courses. As shown, the students represent an ascending scale 
of experience levels in the OS rating (i.e., from OSSA to OSC) as well as various levels in 
the electronic warfare technician (EW), electronics technician (ET), and fire control 
technician (FT) ratings. Also, one officer (ensign) participated in the watch supervisor 
course. The differences among experience levels in these grades would be expected to 
include ECCM and general CIC fleet experience that, in turn, could affect pretest and 
subsequent posttest performance scores. 

Table 2 reveals the types and amount of previous ECCM experience for students in 
the four different courses. The lack of ECCM readiness is indicated by the fact that 66 
percent (N = 235) of the students had no prior ECCM training and the remaining 34 
percent had very little to some exposure to fleet exercises, as shown in Table 2. The 
formal training in ECM recognition received in the four courses ranged from 7 hours in 
watch supervisor and Readiex courses to 20 hours in the ECCM and advanced OS courses. 

Performance Scores 

Table 3 presents the means and standard deviations (SDs) for performance scores for 
pretest, drill and practice, and posttest portions of the basic jamming recognition training 
for the four classes. Posttest means are consistently high and are grouped much closer 
together than pretest means. The reduced SDs on the posttest also indicate more 
homogeneous performance within groups after training. 

A one-way analysis of variance indicated that the classes differed significantly on 
both the pretest (p < .01) and posttest (p < .05). Tukey's post-hoc test of differences was 
performed on pretest and posttest scores to identify the differences between the four 
courses. Table 3, which provides results, shows that students in the ECCM, special 
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Table 1 

Rate Distribution of ECCM Students by Class 



Number of Students 



Rate 


ECCM 


Watch Supervisor 


Readiex 


Advanced OS 


Total 


OSSA- 


12 


2 


0 


0 


14 


OSSN 


40 


17 


2 


0 


59 


OS3 


59 


69 


6 


6 


140 


OS2 


35 


40 


9 


17 


101 


OS1 


5 


14 


0 


1 


20 


OSC 


0 


0 


1 


2 


3 


EW3 


4 


1 


0 


0 


5 


EWC 


0 


1 


0 


0 


1 


ET1 


0 


1 


0 


0 


1 


FTM2 


4 


0 


0 


0 


4 


ENS ' 


0 


1 


0 


0 


1 


Total 


159 


146 


18 


26 


349 


Note. 


The table 


reflects totals for the 


349 students 


who completed the 


student 


questionnaire. 
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Table 2 

Students' Previous ECCM Training 



Number of Students by Class 
Watch Advanced 



Type of Previous ECCM Training 


ECCM 


Supervisor 


Readiex 


OS 


Total 


None 


113 


102 


2 


18 


235 


Read publications aboard ship 


3 


0 '~~ 


0 


0 


3 


Little 


20 


9 


1 


1 


31 


Observed some live jamming 


1 


0 


0 


0 


1 


Advanced team training 


2 


0 


0 


0 


2 


Passive scope observation 


5 


10 


2 


0 


17 


Fleet exercises: 












WESTP AC cruise 


5 


5 


0 


0 


10 


Jamex (jamming aircraft 6c 
simulators) 


19 


9 


2 


<f 


30 


Samex (at sea) 


0 


1 


0 


0 


1 


Dcnoois* 












OS "A" 


0 


1 


1 


0 


2 


Advanced OS course 


2 


0 


0 


0 


2 


EW "A" 


2 


1 


0 


0 


3 


Watch supervisor 


6 


0 


1 


1 


8 


ECCM course 


0 


5 


0 


1 


6 


Air intercept controller 


0 


0 


1 


0 


1 


Total 


178 


103 


10 


25 


356 



Note . The table reflects totals for the 356 students who completed questionnaire. 
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Table 3 



Means and Standard Deviations for Percentage Scores 
on Basic Jamming Recognition Lesson 



Pretest 



Class 


Mean 


SD 


ECCM 


38.45 


32.43 




(N = 


139) 


Watch 


22.19* 


25.60 


Supervisor 


(N = 


122) 


Readiex 


48.60 


39.20 




(N = 


5) 


Advanced OS 


43.56 


30.19 




(N = 


27) 



Drill/Practice 



Mean 



SD 



79.10 15.24 
(N= 162) 

73.68 17.92 
(N= 139) 

70.77 24.07 
(N= 13) 

83.54 12.57 
(N = 28) 



Posttest 



Mean 



SD 



83.13 13.47 
(N = 165) 

83.77 13.82 
(N = 139) 

87.75 17.15 
(N = 12) 

91.48** 8.13 
(N = 29) 



Notes . 

posttek VadanCe 879,75 (df = 289) f ° r the ***** and 179 * 73 (df = 3 ^> ^r the 

analysis. f ° r ° r P° sttest we - re excluded from the 

♦Significant difference from other three classes on pretest. 
♦♦Significant difference from ECCM and watch supervisor classes on posttest. 

ft^M* p?™ dVanCed ° S C °^ ses entered *ai™ng with significantly greater demon- 

SS S? nSSJ r tS 8 ?r^ a ^ ty tha J did thG StUdentS in the watch s ^rvisor courS. 
tE« ^rVX! a 9 /£ CM and watch su P ervisor groups performed significantly lower 
than did the advanced OS group. These differences seem to be reflective of the higher 

CoiS S a ^ 1 ? n l er f ng S ° f SCrViCe ° f the Students in Readiex and advanced 8 OS 
£ n£c* IrSter in ttekSST^ ° f ex ^ ced P*™™* (OSSA, OSSI? OS3) 
R^di"^?^ SUperV1S ° r — (66 *> c <« to the 

' An analysis was made of the difference between pretest and no.sttP.st ,mr.c 

s^nTfiJ^X l"'?** mea n difference scores, their SDs, and t-tests of the 
+ CaC 5 dlfference ' Tne t-tests used a pooled estimate of error since there 
?"52? Clty ° f ™' ance . am °ng the four groups. Results indicate Sat, Shin each 
Attest TJ aS ti S " bstantiaJ and ^g^^nt gain in performance from p etesfto 
d^esXtedngS ^ t0 * ^ in a11 dasseS large 
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Table 4 

_ .. . . Differences between Pretest and Posttest Scores 



Class 


N 


Mean Difference 


SD 


t 


ECQM 


133 


46.42 


32.04 


17.83* 


Watch Sup 


115 


57.44 


27.46 


20.51* 


Readiex 


4 


57.75 


35.20 


3.45* 


Advanced OS 


27 


48.67 


29.57 
\ 


8.42* 



Note , Students with missing data for pretest or posttest were excluded from the analysis. 



*p < .01 (pooled variance = 901.55, df = 275). 



Response Time 

Response time was defined as the number of seconds required from the initial 
presentation of a jamming segment until the student entered and recorded a response. 
There were two jamming types per display (000° and 180° bearing) and the student had to 
identify each. The clock was reset after the first response. 

Mean response times presented in Table 5 reveal a marked reduction in mean 
response time from pretest to posttest and in SDs. It took about 40 seconds for the 
student to identify both ECM presentations on a display. This 40 seconds includes about 6 
seconds average waiting time for the video tape to access the display. Since each sweep 
of the radar takes 12 seconds, students require less than two sweeps to identify a single 
instance of jamming on the posttest. 



Table 5 

Means and Staridard Deviations for Basic Jamming 
Recognition Response Time in Seconds 



Class Pretest Drill/Practice Posttest 





Mean 


SD 


Mean 


SD 


Mean 


SD 


ECCM 


29.22 


12.35 


22.11 


6.37 


20.83 


7.56 




(N = 


139) 


<N = 


162) 


<N = 


165) 


Watch 


29.01 


13.79 


22.60 


6.58 


20.04 


4.94 


Supervisor 


(N = 


121) 


(N = 


139) 


<N = 


138) 


Readiex 


28.00 


12.90 


27.54 


8.93 


18.50 


5.63 




(N = 


5) 


(N = 


13) 


(N = 


12) 


Advanced OS 


26.11 


8.02 


20.54 


4.83 


21.31 


6.10 




(N = 


27) 


(N = 


28) 


(N = 


29) 
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Student Acceptance 



Responses to the student questionnaire indicated that student attitudes were quite 
JavwaWe towards the ECCM training. They liked the TERAK system, the tracing 
IffTSV"! thC m0de ° f irat ™ction. Specifically, students made posit ve comment! 
about the hands-on experience and the opportunity to observe actual jamming sequels 
Being able to actually see jamming on the scope while hearing what type of fix was being 
used ,s an immense help in learning this material" is indicative of a typical student's 
response* 



In responding to the question regarding specific aspects of training liked most, 91 
percent of the students listed using the computer and 53 percent replied that seeing 
jamming was extremely helpful ("one of the best Navy courses I have had in 2K years") 

Sr er K n ?!! r ° r \ hy resp0nSCS t0 this < I uestion included the use of the keyboard (being able 
to push buttons), and the chance to actually apply theory and make judgment calls. 

Students reported that the ECM/ECCM training was extremely helpful and felt that 
it would enhance their performance in the operational setting. In responding to why they 
felt the training was or was not effective, the following comments typify the responses 
made by 86 percent qf the students: "I had never seen jamming befo?e, thTngs Ute Th!s 
SSnT aVaUable ;n the fleet" and "the videotape simualtions weVe much mor? realistic 
than drawings or talking about jamming." Some of the characteristics students reported 
they liked most about the microprocessor-based training were the immediate feedback, 
the emphasis on basics, self-paced study, and the fact that the microprocessor wasfun 
and easy to operate. The following statement summarizes the reaction? of Senior*? 

ScS!*"?-*-? Pre 7 n ? d What YOU ? Ced t0 See t0 8 et a com P lete undersaving of 
nSS^ Criticisms °f *e training included the lack of training in fix application, the 
need for more time on the system, the difficulty at times in disfinguishinXtween ^ 
types of jamming, and the need for improving the photography in some cases. 

n J?*™ ask ^ how much the videotape simulations of the radar scope aid in learning as 
opposed to using a workbook, 72 percent felt the simulated presentation was far luperion 
A typical comment was: "Pictures do not compare to actual video; videoTarSs arfaToi 
more realistic." Students also expressed a liking for being able to view two tvpeVo 
jamming on the same scope, which made it easier to remember differences between types. 

m^J5T re ' fT S V at6d that h WaS easier to 8 et involved and to comprehend the 
material in a videotape format. K 

u , J" ^.P 0 " 25 ? to a question asking to what extent they felt the new training mode 
helped their understanding of all basic ECCM skills, 92 percent replied "to a great exTem" 
or "to a very great extent." When asked to compare this micro^ocessor-tesed trainme 
with-bther methods of learning, 100 percent rated h as en^e S^^n^^ When 
rating microprocessor-based training in relation to other training they have Txperienced 
79 percent rated ,t as "outstanding," with the remaining 21 percent rating it as 4 to ve 
average." All of the students felt that the feedback provided on their £ romance dl £ng 
drill and practice was an effective aid to learning. Ninety-three percent reported thaf 

Z flee? 8 te eff6CtiVe in enabUng th ^ m t0 reC °S nize ^l^i tcml 



CONCLUSIONS 

The use of a microprocessor-based training system for providing ECCM simulation k 
a feasible methodology for ECCM training. Th% system afforded student* TopptCity 



erJc n 



to observe and respond to various jamming scenarios. Overall indications from objective 
performance scores and from student and instructor reactions were that the training 
system was very effective for training the "hands on" portion of the ECCM course. 
Microprocessor-based training provides a valuable addition to the established ECCM 
course. Fleet school instruction personnel judge the microprocessor-based training 
systems capable of functioning on a stand-alone basis as they were designed to do. 
Implementation of microprocessor- based training systems at fleet schools and at remote 
sites would give radar operators access to interactive training that has not previously 
been available through fleet exercises, traditional classroom instruction using insturc- 
tfc.ial texts with still photographs, or any sort of on-the-job training. Successful 
implementation of such a system should lead to improved ECCM performance capabilities 
while requiring minimal capital investment. Much of the necessary training in ECM 
recognition and ECCM can be accomplished through systems similar to the low-cost 
system reported on here without the need for high cost simulators. 



FUTURE DIRECTION 

Beyond implementing lessons that have been developed to date, further development 
will include the following extensions to the existing lessons: (1) revision of current lessons 
to augment their training effectiveness, (2) interfacing the videotape player with the 
microprocessor, (3) establishing time and accuracy criteria for operator performance, and 
(4) determining optimal sequencing for operator refresher training. 

Revision of the present lessons would involve presentation of ECCM effects from 
both a simulated and cognitive perspective. For example, the rationale for employing a 
particular ECCM type would be presented on the computer monitor while examples of 
simulated presentations depicting the effects are shown. 

Interfacing the videotape player with the microprocessor to bring the selection and 
presentation of videotape segments under computer control would provide several 
advantages. Computer control of videotape presentations would result in an automatic, 
and thus, more rapid, presentation of video segments. In addition, computer control of 
video presentation would provide optimized sequencing of particular video segments (e.g., 
for review purposes) and therefore better individualized instruction. At this time, a 
computer interface for the Terak microprocessor is not available but a low-cost interface 
is now being developed (in-house) and is expected to be in use by about November 1981. 

Student accountability must be incorporated into the overall ECCM improvement 
plans. A precise definition of ECCM personnel performance objectives for the OS and FT 
ratings is needed so that training goals can be firmly established. The microprocessor- 
based training system facilitates individual student accountability by enabling the student 
to practice ECCM skills until an acceptable level of performance is achieved. 

Schendel, Shields, and Katz (1978) conclude that proficiency of basic combat training 
skills cannot be maintained in the absence of regular practice. ECCM skills are highly 
perishable and refresher training will be necessary to maintain readiness. ECCM 
operational skills involve a complex configuration of task elements, which include 
identification, classification, and procedural skills. An important area for future research 
involves determination of the frequency, type, and amount of refresher training required' 
to maintain previously attained skill levels. 
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RECOMMENDATIONS 



ERIC 



1. Microprocessor-based training systems should be implemented for ECCM train- 
ing. Extensive use of microprocessor-based simulation training at fleet schools and 
remote sites should make a significant impact on closing the gaps between training 
requirements and current training capabilities. A future area for research would involve a 
feasibility study of whether a lower-cost (approximately one-third the cost of the Terak) 

™.T ght . ly . Iess Po^rf" 1 microprocessor would meet the requirements for providing 
ECCM training. ^ 6 

2. Additional radar specific E XM training media (e.g, videotapes) and computer- 
based lessons to continue to increase the materials required to provide initial and 
refresher training should be developed. Performance training cannot be effectively 
accomplished in the absence of appropriate ECM (actual or synthetic). 

3. Students who have received initial ECCM training should be tracked to 
determine skill loss, determine optimal sequencing, and initiate schedules for ECCM 
refresher training. After initial ECCM training at Fleet Combat Training Centers, 
Atlantic/Pacific, refresher training could be conducted at locations where Fleet Training 
Groups are present. ax,u, % 

• ■ *• ■ ^ CC x M a PP lication lessons designed to train students in ECCM types and options 
in .level of effectiveness order for countering ECM should be developed and evaluated. 
These lessons should include practice in applying ECCM techniques associated with 
specific radar systems and individualized performance testing. 

♦ \ f r f a l sibilitv tests for implementing microprocessors and ECCM training at remote 
sites should be conducted. 6 

6. An F.CM reporting lesson and an EW threat evaluation lesson should be developed 
and evaluated. ^ 
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